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ABSTRACT 

The Vocational Education Act of 1963 (P. L. 88-210) 
specified that funded programs undergo periodic and regular 
evaluation to determine if participants are being adequately prepared 
for employment. A quasi-experimental method for objectively 
evaluating pilot programs is to use appropriate reference groups in 
lieu of the traditional experimental control group dyad. Appropriate 
reference groups may consist of similar people . without instruction in 
the vocation, successful practitioners of the vocation, and students 
in regular vocational high school programs. Evaluation instruments 
should provide performance measures of those abilities and knowledges 
required by the vocation under study. Instrument design should duly 
consider whether the evaluation is summative or formative, that is, 
for administrative evaluation of the total program or for internal 
evaluation. When the behavioral performance-reference groups model 
was tested in a summative evaluation of pilot Commercial Food Service 
programs in New Jersey, graduates of regular vocational high school 
programs scored significantly higher than graduates of pilot 
programs. Although further study is necessary, the initial findings 
question the adequacy of training in pilot programs. The evaluation 
model can be readily used in summative evaluations, (CH) 
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CHAPTER I - INTRODUCTION 



Educators have long recognized the need for educational evaluation 
and have practiced various forms of assessment. The Vocational Education 
Act of 1963 (P.L. 88-210) has further specified that programs funded un- 
der the Act undergo periodic and regular evaluation. 

The Problem 

The evaluation method used must allow for any new instructional 
approach or procedure. The only restriction in this matter has again 
been dictated by P.L. 88—210. The Act defines vocational education in 
terms of preparing people for employment. 1 Thus, the only initial re- 
striction that may be placed upon the program is to require the students 
to be employable as a result of the education received. The evaluation 
must also give immediate results. Decisions must be made regarding the 
program, even as the students graduate, if not before the first class grad- 
uates. 

It is also desirable that the method of evaluation be applicable to 
parts Gf the program as well as the program as a whole. Evaluation of the 
total program is quite satisfactory for external (summative) administra- 
tive evaluation, where the administrator only needs to decide whether or 
not he should keep on funding this or similiar programs. Evaluation of 
specific parts of the overall program are also necessary in order to make 

^ -Vocational Education Act of 1963 . Pub. L. 88-210, 88th Congress, 
1963, H.R. 4955, p.6. 
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specific decisions. This type of internal (formative) evaluation is 
separate from, but not necessarily unrelated to, the overall summative 
evaluation which may lead to administrative decisions. 

The question then is: do we have an objective method, or methods, 

of evaluating pilot programs? 

Review Of The Literature 

A recent national conference on the evaluation of vocational ed- 
ucation considered several commonly accepted forms of evaluation. Fa- 
pers were presented by experts in the use of each of these forms. Fol- 
lowing is a brief review of each form. 

Accreditation is a method of educational evaluation which has long 
been in use. The acceptance of accreditation is one of logic. Accredi- 
tation assumes that if certain facilities, conditions, and attitudes are 
present, quality education is the outcome. 2 Probability usually supports 
this logic, and accreditation is recognized as a long term national force 
in the improvement of education. The recognition of the success of the 
concept of accreditation is so widespread that many evaluative criteria 
checklists are published as unofficial offshoots of accrediting activities. 

The self-evaluation of the accrediting procedure should not be dis- 
counted. Without this procedure educatiors are frequently kept so busy 
"minding the store" that they do not voluntarily take time to examine it 
in detail. But when one is examining a new experimental program what must 

2 Frank C. Dickey, Accreditation by Regional Accrediting Associations 
as a Technique for Evaluating Vocational and Technical Education 
Programs . A paper presented at the National Conference on Evaluat- 
ing i Vocational & Technical Education Programs, Atlantic City, N. J., 
Oct. 6, 1968, appendix A. 
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